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© A system for processing audio and video com- 
ponents of a television signal provides for automatic 
control of closed caption signal display in response 
to the status (220) of an audio muting feature. The 
system includes an operating mode in which en- 
abling audio muting (MUTE ON) also enables the 
closed caption display (250) and disabling muting 
(MUTE OFF) disables generation of the closed cap- 
tion display (280). 
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The present invention relates to television sys- 
tems that include capability for processing auxiliary 
video information such as closed caption data. The 
video signal processing section of a television sys- 
tem may include capability to decode and display 
auxiliary video information such as closed caption 
data. Closed caption data includes digital data in 
the form of ASCII characters that represent the 
audio information in a television signal. Display of 
closed caption data on a television display is in- 
tended to provide a visible representation of the 
audio program as an aid to hearing impaired televi- 
sion viewers. In the United States, the closed cap- 
tioning standard is promulgated in Federal Commu- 
nications Commission (FCC) regulations (see e.g. 
47 CFR §§ 15.119 and 73.682). FCC regulations 
specify that digital closed caption data is transmit- 
ted in line 21 of field 1 in the video signal. Data 
representative of two ASCII characters is transmit- 
ted in each occurrence of line 21 in field 1 . Future 
modifications to the standard may provide for 
closed caption data to be located in other lines, 
e.g. line 21 of every field. 

Closed caption data is decoded from the video 
signal by a decoder. The decoded signal is coup- 
led to the video display when closed captioning is 
enabled. Typically, a hearing impaired viewer en- 
ables closed captioning by activating a switch (e.g. 
on a remote control or on a control panel of a 
television) or by selecting closed captioning from a 
menu displayed on the video screen during a con- 
trol mode of operation. Once activated, closed cap- 
tioning remains enabled until disabled by the view- 
er. A viewer that is not hearing impaired would tend 
to disable closed captioning to avoid having the 
closed caption display encroach on the displayed 
video program. 

A television system may also include an audio 
muting feature in the audio signal processing sec- 
tion. Activating audio muting causes the audio out- 
put from the television to be disabled. The volume 
control setting and the displayed video program 
are not affected. When audio muting is disabled, 
the normal audio output is reestablished without 
adjustment of the volume control. Audio muting 
may be activated, for example, via remote control, 
control panel, or displayed menu features in a 
manner similar to the activation of closed caption- 
ing. 

Audio muting may be useful in a variety of 
circumstances. For example, a user may wish to 
disable the audio output (i.e. enable muting) when 
answering the phone or during a conversation. Al- 
though audio muting provides a useful effect by 
eliminating the noise of the audio program, a view- 
er may undesirably lose important information dur- 
ing audio muting if the viewer is relying on hearing 
the audio program as part of the enjoyment or 



comprehension of the television program. 

The present invention resides, in part, in rec- 
ognition of the described problem and, in part, in 
providing a solution to the problem. More specifi- 

5 cally, in accordance with the principles of the 
present invention, a system for processing a televi- 
sion signal includes video and audio signal pro- 
cessing channels for generating video and audio 
output signals, respectively. The video signal pro- 

10 cessing channel includes capability for decoding an 
auxiliary information signal component from the 
video signal and for including the auxiliary informa- 
tion signal in the video output signal. The audio 
signal processing channel includes capability for 

75 disabling generation of the audio output signal dur- 
ing a predetermined condition of the television sys- 
tem. In a particular operating mode of the system, 
the auxiliary information signal is included in the 
video output signal when generation of the audio 

20 output signal is disabled. Also, the auxiliary in- 
formation signal is excluded from the video output 
signal when generation of the audio output signal is 
enabled 

The invention may be better understood by 
25 referring to the enclosed drawing in which: 

Figure 1 shows in block diagram form an em- 
bodiment of a portion of a television signal pro- 
cessing system incorporating the principles of 
the present invention; 
30 Figure 2 illustrates in flowchart form the opera- 
tion of an aspect of the embodiment depicted in 
Figure 1 ; and 

Figure 3 depicts, partially in block diagram form 
and partially in logic diagram form, an embodi- 
35 ment of a feature shown in the block diagram in 
Figure 1. 

In Figure 1 , a television signal processing sys- 
tem includes video signal processing channel 100 
and audio signal processing channel 150 for pro- 

40 cessing respective video component VIDEO IN and 
audio component AUDIO IN of an input television 
signal. Video component VIDEO IN may include an 
auxiliary information component such as closed 
caption (CC) data that is decoded from the video 

45 component by closed caption decoder 110. On- 
screen display (OSD) processor 120 responds to 
signals including the decoded closed caption data 
to generate on-screen display signal OSDOUT. 
OSD processor 120 is enabled to produce a dis- 

50 play of closed caption data in response to an 
appropriate level on signal CCEN (e.g. logic 1). 
Other applications of OSD processor 120 include 
generation of a channel number indicator display or 
generation of menu displays that permit a user to 

55 control features such as volume by selecting menu 
items. 

OSD processor 120 also controls the portion of 
the video display in which OSD information such as 
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closed caption data is displayed via video switch 
130. Switch 130 responds to signal OSDSEL from 
OSD processor 120 to select the source of signal 
VIDEO OUT. For example, signal OSDSEL at logic 
0 causes switch 130 to couple signal VIDEO to 
signal VIDEO OUT and signal OSDSEL at logic 1 
causes signal OSDOUT to be coupled to signal 
VIDEO OUT. When on-screen display information 
is to be displayed, signal OSDOUT is coupled to 
signal VIDEO OUT. 

To ensure that OSD information is displayed at 
the correct time, i.e. in the correct portion of the 
video display, the operation of OSD processor 120 
is synchronized with the operation of video proces- 
sor 100 via one or more synchronization signals 
represented by signal SYNC in Figure 1. Signal 
SYNC may include vertical and horizontal sync 
signals such as those produced by deflection and 
sync separator functions. Briefly, synchronization to 
video input signal VIDEO IN via signal SYNC 
makes it possible for OSD processor to determine 
when particular video lines and video fields begin. 
For example, OSD processor 120 may initialize a 
counter in response to a vertical sync signal and 
count horizontal lines in response to a horizontal 
sync signal. In addition, OSD processor 120 may 
include a counter that is initialized in response to 
horizontal sync signals and counts delay (i.e. posi- 
tion) within each horizontal line. When the horizon- 
tal line count and the horizontal delay count in- 
dicates that the "OSD portion" of the video display 
is to be displayed, OSD processor 120 generates 
an appropriate level (e.g. logic 1) on signal OSD- 
SEL to couple signal OSDOUT to signal VIDEO 
OUT. 

Also in Figure 1 , audio signal processing chan- 
nel 150 processes audio component AUDIO IN to 
produce signal AUDIO. Audio mute capability is 
provided illustratively in Figure 1 by audio switch 
160 operating in response to signal MUTE. When 
audio output is enabled (e.g. signal MUTE at logic 
0), switch 160 couples signal AUDIO to signal 
AUDIO OUT. When audio muting is enabled (e.g. 
signal MUTE at logic 1), switch 160 decouples 
signal AUDIO from signal AUDIO OUT and couples 
signal AUDIO OUT to ground, thereby preventing 
an audio output signal from being produced. 

Signals CCEN and MUTE are generated by 
decode and control unit 140 in response to user 
input information indicated as signal USER INPUT 
in Figure 1. For example, a television viewer may 
activate a switch on a remote control to select 
muting. Decode unit 140 detects activation of the 
switch, determines the function selected, and pro- 
vides the appropriate control signals. In the case of 
a function such as muting, activation of a muting 
switch may cause the existing state of muting 
control signal MUTE to be toggled. For example, if 



signal MUTE is at logic 0 indicating that muting is 
disabled, activating a muting switch will cause sig- 
nal MUTE to become logic 1 enabling muting. 
When muting is enabled, activating the muting 

5 switch will disable muting. 

Signal CCEN is generated in response to user 
input commands related to closed captioning 
modes of operation. For example, typical closed 
captioning modes of operation may include en- 

w abling closed captioning at all times (e.g. for a 
hearing impaired viewer) or disabling closed cap- 
tioning at all times (e.g. for viewers who are not 
hearing impaired). These modes of operation may 
be selected via an appropriate user input feature 

75 (e.g. a remote control, a control panel, or selection 
of a menu item in a displayed menu). Selecting 
closed captioning at all times provides display of 
closed caption when audio muting is both enabled 
and disabled. This mode of operation is referred to 

20 herein as "closed caption with audio" mode. To 
control closed caption with audio mode of opera- 
tion, decode and control unit 140 generates signal 
CCEN by toggling the present state of signal 
CCEN in a manner similar to the described tog- 

25 gling of signal MUTE. 

Decode and control unit 140 also generates 
signals CCEN and MUTE to provide a mode of 
operation referred to herein as "closed caption with 
mute" mode in which closed captioning is auto- 

30 matically enabled and disabled in response to en- 
abling and disabling, respectively, of muting. As 
with closed caption with audio mode, closed cap- 
tion with mute mode of operation may be selected 
by activating an appropriate user input feature. 

35 During closed caption with mute mode, signal 
MUTE automatically causes signal CCEN to enable 
OSD processor 120 to generate a closed caption 
display. When signal MUTE disables muting, signal 
CCEN disables closed captioning. Once closed 

40 caption with mute mode is selected, a user may 
visibly monitor the audio program during muting by 
activating only the muting control. 

The described functions of decode and control 
unit 140 may be produced by a microprocessor 

45 under appropriate software control. Figure 2 shows 
a flowchart illustrating an approach to microproces- 
sor generation of signals CCEN and MUTE. When 
a muting switch is activated (or the status of a 
menu item relating to muting is changed), signal 

50 MUTE is toggled as described above. In response 
to the change in state of signal MUTE, the micro- 
processor enters the routine shown in Figure 2 at 
step 200. At step 210, the microprocessor deter- 
mines whether or not the user has selected closed 

55 caption with audio mode of operation by, for exam- 
ple, testing a flag that is set when a user selects 
that mode of operation. If closed caption with audio 
mode is selected, a closed caption display is gen- 
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erated at all times independent of the status of 
muting. As a result, no testing of the muting status 
is required and the microprocessor exits the routine 
in Figure 2 at step 290. 

If closed caption with audio mode is not se- 
lected, operation continues at step 220 where the 
status of audio muting is tested by, for example, 
testing the state of signal MUTE. The test at step 
220 occurs after the state of signal MUTE is tog- 
gled at step 200. If muting is enabled, operation 
proceeds from step 220 to step 240 where the 
microprocessor determines whether or not closed 
caption with mute mode is selected by, for exam- 
ple, testing an appropriate flag. If closed caption 
with mute mode is selected, closed captioning is 
enabled at step 250 by the microprocessor estab- 
lishing the appropriate state of signal CCEN in 
Figure 1 (e.g. a logic 1 to enable closed caption- 
ing). The microprocessor then exits the routine in 
Figure 2 at step 290. If closed caption with mute 
mode is not selected, step 250 is bypassed and 
the microprocessor proceeds directly to step 290 
exiting the routine. 

When the audio status test at step 220 in- 
dicates that muting is disabled, operation continues 
at step 280 rather than step 240. A necessary 
condition for reaching the audio status test at step 
220 is that closed caption with audio mode is not 
selected (test at step 210). Therefore, if step 220 
indicates that muting is disabled (i.e. audio en- 
abled), closed captioning is disabled. This is ac- 
complished at step 280 where closed captioning is 
disabled by establishing the appropriate state of 
signal CCEN (e.g. logic 0). Following step 280, the 
routine is exited at step 290. 

Figure 3 shows a digital logic approach to 
implementing certain features depicted in the 
flowchart in Figure 2. In Figure 3, decode unit 300 
may be hard-wired decode logic or a microproces- 
sor that interprets user commands USER INPUT. 
Decode unit 300 generates various control signals 
including signals CCAUDIO, CCMUTE, and MUTE. 
Signals CCAUDIO ad CCMUTE indicate that closed 
caption with audio and closed caption with mute 
modes of operation are selected, respectively. Sig- 
nal MUTE is representative of the muting status as 
described above. All three signals are held con- 
stant by decode unit 300 until user input changes 
the state of the closed caption mode or muting. 

In Figure 3, signal CCAUDIO at logic 1 in- 
dicates that closed caption with audio mode is 
selected. OR gate 350 responds to signal 
CCAUDIO at logic 1 by causing signal CCEN to be 
at logic 1, thereby enabling closed captioning in- 
dependent of signal MUTE. If closed caption with 
audio mode is not selected (i.e. signal CCAUDIO at 
logic 0), closed captioning may be enabled via 
AND gate 340 when closed caption with mute 



mode is selected (signal CCMUTE at logic 1) and 
muting is selected (signal MUTE at logic 1). Signal 
CCEN is at logic 0 (i.e. closed captioning disabled) 
if signals CCAUDIO and CCMUTE are both at logic 

5 0. The arrangement in Figure 3 may be modified to 
accommodate enabling closed captioning in addi- 
tional operating modes by adding an input to OR 
gate 350 to receive each additional control signal 
for enabling closed captioning. 

w Either implementation of decode and control 

unit 140, i.e. the microprocessor based control ap- 
proach shown in Figure 2 or the digital logic ap- 
proach in Figure 3, may be included within the 
functions of OSD processor 120. Also, functions 

75 such as closed caption decoder 110, decode and 
control unit 140, and OSD processor 120 may 
included in a single OSD integrated circuit. 

Although the present invention is described in 
the context of user control of an audio muting 

20 function, the present application may also be useful 
in situations where muting is activated automati- 
cally during a particular operating mode of a televi- 
sion system. In addition, the invention may be 
useful in television systems that provide for pro- 

25 cessing types of auxiliary video information other 
than closed captioning, e.g. teletext. 

Claims 

30 1. In a system for processing a television signal 
including a video component and a related 
audio component corresponding to respective 
visible and audible portions of the same televi- 
sion program, said audio portion containing a 

35 spoken portion related to said visible portion of 

said television program, said video component 
containing an auxiliary information component 
corresponding to a visible representation of 
said spoken portion of said television program, 

40 apparatus comprising: 

means (100) responsive to said video 
component for generating a video output signal 
(VIDEO) corresponding to said visible portion 
of said television program; 

45 means (110,120,140) responsive to said 

auxiliary information component for selectively 
generating an auxiliary information output sig- 
nal (OSDOUT) corresponding to said visible 
representation of said spoken portion of said 

50 television program related to said visible por- 

tion of said television program; 

means (130) for including said auxiliary 
information output signal, when generated, in 
said video output signal for displaying said 

55 visible representation of said spoken portion of 

said television program together with said re- 
lated visible portion of said television program; 
means (150) responsive to said audio 



4 



7 EP 0 614 315 A2 8 



component for generating an audio output sig- 
nal (AUDIO) corresponding to said audible por- 
tion of said television program; 

means (160) for inhibiting the normal gen- 
eration of said audio output signal during a 5 
predetermined operating condition of said sys- 
tem; wherein 

said auxiliary information output signal 
generating means (110,120,140) is coupled to 
said audio output signal inhibiting means (160) w 
for generating said auxiliary information output 
signal during said predetermined operating 
condition of said system when enabled to do 
so; and 

means are coupled to said auxiliary in- w 
formation output signal generating means for, 
in a first mode, enabling said auxiliary informa- 
tion output signal generating means to gen- 
erate said auxiliary information signal during 
said predetermined operating condition of said 20 
system, and for, in a second mode, disabling 
said auxiliary information output signal generat- 
ing means from generating said auxiliary in- 
formation output signal during said predeter- 
mined operating condition of said system. 25 

2. The apparatus of claim 1 further comprising: 

means responsive to activation by a user 
for generating a control signal (MUTE); and 
wherein 30 

said audio output inhibiting means (160) is 
an audio muting circuit responsive to said con- 
trol signal for disabling the generation of said 
audio output signal to establish said predeter- 
mined operating condition; and 35 

said auxiliary information output signal 
generating means, in said first mode, is re- 
sponsive to said control signal for generating 
said auxiliary information output signal when 
audio muting is enabled and, in said second 40 
mode, is not responsive to said control signal 
for generating said auxiliary information output 
signal when said audio muting is enabled. 

3. The apparatus in claim 2 wherein said auxiliary 45 
information output signal is a closed caption 
signal. 

4. The apparatus recited in claim 1, wherein: 

said means coupled to said auxiliary in- 50 
formation output signal generating means is 
selectively enabled to generate or disabled 
from generating said auxiliary information out- 
put signal during said predetermined operating 
condition in response to activation of an input 55 
device by a user (USER INPUT). 
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